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[57] 



ABSTRACT 



An image processing system including a correction pattern 
storing unit for storing correction patterns set corresponding 
to kinds of color fogs, a correction pattern selecting unit for 
selecting a correction pattern suitable for correction of input 
image, a correction amount storing unit for storing a cor- 
rection amount indicative of an appropriate degree of cor- 
rection on color fog, a tone curve generating unit for 
generating a tone curve of RGB based on a selected correc- 
tion pattern and a correction amount stored in the correction 
amount storing unit, and an LUT converting unit for per- 
forming table conversion on image data of input image 
according to a generated tone curve to conduct color con- 
version processing of all the pixels of image data. 

6 Claims, 14 Drawing Sheets 
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FIG. 8 
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FIG. 14 ( PRIOR ART) 
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IMAGE PROCESSING SYSTEM AND ITS light sources, is impossible to correct solely based on the 

SMOOTHING METHOD FOR CORRECTING properties of different light sources, making this method 

COLOR FOG AND BACKLIGHT OF A inadequate for obtaining good correction results. 

DIGITAL IMAGE Next, backlight correction is described. Conventional 

5 backlight correcting systems include an automatic exposure 

BACKGROUND OF THE INVENTION control device, for example, a video camera. This type of 

1 Field of the Invention system controls the diaphragm so as to maintain the level of 

' . output signals constant. Means of controlling the diaphragm 

fhe present invention relates to an image processing indude the mean value method tfaat obtains ^ me£m yalue 

system for processing digital image data and its image 1Q 0 f brightness of an entire screen, the peak value method that 
smoothing method, and more particularly to an image det ects the maximum value of brightness of a screen, and the 
processing system and its smoothing method characterized method that com5ines 5oth< A diaphragm ^ 
by the means employed for correcting an input image t icall located a , ens m ^ u 

recorded in a color fog state and in a backlight state. of incident Hght tQ make the screen brighter Qr dark H er ^ 

2. Description of the Related Art 15 type of conventional backlight correcting system is 
When processing digital image data by use of a computer- disclosed, for example, in Japanese Patent Laid-Open Pub- 
based image processing system, various forms of smoothing lication No. 6-46325, "Automatic Exposure Control Sys- 
are performed on the image data as necessary. Hereafter, tem". The same publication describes a system that esti- 
color fog and backlight correction by use of a conventional mates the intensity of backlight based on the brightness data 

image processing systems is described. 20 for a screen and determines how much the diaphragm should 

First, color fog correction is described. In the color fog be controlled using the value thus obtained, 
correcting method used by conventional image processing Th e conventional backlight correction device disclosed in 
systems, the tone curve of the RGB is interactively modified; {h& same publication is described with reference to FIG. 15. 
the operator corrects the colors of an image while confirm- 1 Q 1 5 > a subject image is formed on an image pickup 

ing the results of his operation. 25 device 1503 via a lens 1501 and a diaphragm 1502, con- 

This conventional method focusing on smoothing the tone verted mto an ele ffi c ff s ^ na1 ' * nd out P ut throu S h a si S nal 
curve of the RGB interactively, however, requires too many P rocessin g circuit 1505 for performing the Y processing and 
adjustment parameters for the operator to perform smooth- ° ther tasl f At ^ tmie > th L e d^phragm control is performed 
ing intuitively, thereby giving rise to a drawback of longer b * ™ C of a S1 ^ al from lhe una S e P lcku P device 1503 as 
operation time. Furthermore, this method requires experi- 30 , . . * ™ , 

ence and skill so that those having no or little experience are ^screen mean value detecting unit 1507 detects the 

unable to perform smoothing as desired. ™ m bngltoas of fall screen. Subsequently, the dia- 

^ . ^ j. . n phragm control unit 1506 determines the diaphragm aperture 

This .type of conventional .mage processing system for M M , 0 achieve a brightness . A smaller region mean 
smoothing color ^ disclosed fo^ examp Je. in Japanese 35 value detecti ^ 1508 divides , XKCn int0 ^ 
Patent La.d-Open Publication No. 2-94893, "Image Process- ions ^ ca , cu , ates , he mean yalue of ^ bbck A 1qw 

mg System . The same publication describes a system which 5ri ^ trjess mean value calculating unit 1509 arranges ^ the 
allows correction depending on the spectral properties ot order of M htn 

ess the mean values of brightness of respec- 
different types of hght source. « • ii.il.i_ 11 ■ 

Jr & tive small regions calculated by the smaller region mean 

The conventional image processing system disclosed in 40 value detecting unit 1508, and selects a predetermined 

the same publication is described with reference to FIG. 14. number of small regions sequentially from the small region 

In FIG. 14, a spectral properties storing means 1402 stores 0 f the lowest brightness, and calculates the mean brightness 

the amounts of correction to be made for three color 0 f the regions thus selected. A backlight degree calculating 

components, i.e., red, green, and blue, depending on the un i t 1511 calculates the degree of backlight from the mean 

spectral properties of different types of light source. A 4 5 brightness of the several selected regions calculated by the 

correction amount retrieving means 1403 retrieves the i ow brightness mean value calculating unit 1509. A target 

amount of correction for a specified Hght source from the brightness calculating unit 1510 modifies the target aperture 

spectral properties storing means 1402 and inputs it into a so as to enlarge the diaphragm aperture when the degree of 

color correcting means 1401. The data stored in an input the backlight calculated by the backlight degree calculating 

image buffer 1400 is subjected to color correction by the 50 unit 1511 becomes larger, and modifies the target aperture so 

color correcting means 1401 and output to an output image as t0 re duce the diaphragm aperture when the degree of the 

buffer 1404. Assuming that the input pixel values are R, G, backlight becomes smaller. 

and B, and that the output pixel values are R', G', and B', i n conventional backlight correcting systems, backlight is 
color correction is performed using the following expression corrected by adjusting the diaphragm aperture so as to enter 
(1). 55 the greater quantity of light or the smaller quantity of light. 

This aims to control the device, a video camera or the like, 
R'=R/rO, G'-G/gO, B'-B/bO (i) directly. The similar correcting method cannot be used for 

the data once quantized and stored as a digital image. 
This correcting method multiplies the RGB value by the Considering diaphragm control as image processing, y 
constant term. 60 correction conversion as illustrated in FIG. 16 is the closest 

In the correcting method that simply multiplies the RGB conversion to backlight correction through the above- 
values by the constant term, however, it is impossible to mentioned modification of the diaphragm aperture. When 
smooth all the colors of respective light sources completely, diaphragm is not changed, the input value of brightness is 
resulting in the inability to achieve the best possible color the same as the output value of brightness, as illustrated in 
through correction. In addition, a color fog state that has 65 the conversion characteristic 1603. An enlarged diaphragm 
been caused by such factors as film, lens, and exposure aperture has characteristic as illustrated in the conversion 
characteristics, along with color variances among different characteristic 1601 for a large aperture and a reduced 
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diaphragm aperture has the characteristic as illustrated in the correction pattern selecting means and the correction 

conversion characteristic 1602 for a small aperture. amount stored in the correction amount storing means, and 

Since the range of partial light quantities in the scenery of LUT conV erting means for performing table conversion 

the natural environment is being recorded by a video on im data of the ; , ; based Qn , he tQne curve 

camera, the brightness value in the shadow region (the 5 ated by the tone curve generatmg means t0 ^duct 

darkest region in the image) will not be increased uniformly colQr oonveraion processm * f M the pixels of the image 

when the diaphragm is enlarged; instead, more information , ° r ° 

on the shadow region is recorded as contrast intensifies. In a a ' 

the case of image data, however, since brightness informa- The image processing system may further comprise cor- 
don on the shadow region has already been quantized and rection amount specifying means for specifying a correction 
compressed, y correction would not increase the brightness amount to be stored in the correction amount storing means 
information on the shadow region. In other words, the according to each correction processing by the operation of 
shadow region becomes brighter uniformly to an excessive an operator. 

level. The tone curve generating means may comprise 

In a video camera, the value of the quantity of light in the ^ highlight control amount calculating means for calculat- 

backlight portion is always near "0". In an image data input mg a contro l amount of a highlight region in each compo- 

from a color photographic film through a scanner, the value nent of RGB based on the correct i on pattern and the cor- 

of the light quantity in the backlight portion does not always rection amount 

represent the pixel value near "0" For a photography printed hjJf tQne amount calculatin means for ca]culati 

with the backhght portion slightly brighter the backlight ffl a of a ^ tone ^ ^ nent of 

C^^ 111 , V1Cim S; \1 QI eXamP i C ' u P 7lZ RGB based on the correction pattern and the correction 

"30". With reference to FIG. 16, an input backlight unit 1604 amount 

corresponds to the backlight portion. Through the v correc- ' 

tion for the image data, the brightness value of the backlight shadow amount calculating means for calculating 

portion is converted into an output backlight portion 1605. , c a ° f a shadow re S lon m ca ° h component of 

As illustrated in FIG. 16, the range of the output backlight 25 RGB based on the correction pattern and the correction 

portion 1605 in this case is narrower than the range of the amount, 

input backlight portion 1604. In other words, although the ^nc curve calculating means for calculating the tone 

backlight portion in the image becomes brighter, the range curve of each component of RGB based on the three kinds 

of the brightness becomes narrower, thereby deteriorating 3Q of control amounts calculated by the three kinds of control 

the contrast condition and consequently the image quality. amount calculating means, 

The conventional backlight correction technique for digi- a straight line generating module for use in the tone curve 

tal image data, although it simulates the diaphragm control calculating processing by the tone curve calculating means 

by a camera through the y correction for the data, is actually to conduct straight line interpolation between a control point 

incapable of performing a good backlight correction in the 3g in a high brightness region and a control point in a low 

correction of the digital data. brightness region, and 

SUMMARY OF THE INVENTION a curve generating means for use in the tone curve 

„ t_- c . - • . j calculating processing by the tone curve calculating means 

One objective of the present invention is to provide an 4 j * • « i *• c tU1 • , , 

J . . i_i e -i u to conduct curve interpolation for smoothly interpolating 

image processing system capable of easily executing such , , 4 . .\. , ir , . j « 

4 , . . j . Af\ between a control point in a half tone region and starting 

complicated correction operations as correction according to HU . . , r , . Ut , v ° , . . ° 

. ,K , , . r , r & points on the high brightness side and the low brightness 

the light source colors and correction of a snowy scenery. ^ & & » 

Another objective of the present invention is to provide an »' t , r . . . . 

t_i r j • *• *j According to the second aspect ot the invention, digital 

image processing system capable of reducing time required . , t & . , • • • T 

or o j r o i ( image data correcting method in an image processing system 

for operation and consequently reducing manhours through , . & , . & • j - • , 

j a- - 11 11 * * 45 which conducts necessary correction processing on digital 

increased emciency as well as allowing any operator to , , 3 ~ r & 

obtain desired correction results, regardless of the level of ma 8 e data ' com P rises the s,e P s of 

skill and experience among correction patterns set corresponding to kinds of 

One more objective of the present invention is to provide color fo § s ' /electing the correction pattern suitable for 

an image processing system capable of correcting backhght correction of input image by the operation of an operator, 

without decreasing the contrast by giving the characteristic 50 obtaining a correction amount indicative of an appropriate 

of correction to a greater brightness the medial pixels degree of correction on color fog, 

brighter than the shadow region. generating a tone curve of RGB based on the correction 

According to the first aspect of the invention, an image pattern selected at the correction pattern selecting step and 

processing system which conducts necessary correction pro- 55 tne correction amount obtained at the correction amount 

cessing on digital image data, comprises obtaining step, and 

correction pattern storing means for storing correction performing table conversion on image data of the input 

patterns set corresponding to kinds of color fogs, image according to the tone curve generated at the tone 

correction pattern selecting means for selecting the cor- curve generating step to conduct color conversion of all 

rection pattern suitable for correction of input image among 60 pixels of the image data. 

the correction patterns stored in the correction pattern stor- The tone curve generating step comprises the steps of 

ing means through the operation of an operator, calculating a control amount of a highlight region in each 

correction amount storing means for storing a correction component of RGB based on the correction pattern and the 

amount indicative of an appropriate degree of correction on correction amount, 

color fog, 65 calculating a control amount of a half tone region in each 

tone curve generating means for generating a tone curve component of RGB based on the correction pattern and the 

of RGB based on the correction pattern selected by the correction amount, 
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calculating a control amount of a shadow region in each first conversion table generating means for generating a 

component of RGB based on the correction pattern and the conversion table by using the parameter calculated by the 

correction amount, and parameter calculating means, and 

calculating the tone curve of each component of RGB second conversion table generating means for generating 

based on the three kinds of control amounts calculated at 5 the backlight correction table based on the conversion table 

each the steps, wherein generated by the first conversion table generating means and 

at the time of calculating a tone curve, the tone curve the shadow region brightness value extracted by the shadow 

calculating step performing region brightness value extracting means, 

a straight line generating module for conducting straight the second conversion table generating means may 

line interpolation between a control point in a high bright- 10 include 

ness region and a control point in a low brightness region, backlight correction characteristics calculating means for 

a °d calculating, with reference to a brightness value of a pixel in 

a curve generating module for conducting curve interpo- i mage data of input image, the shadow region brightness 

lation for smoothly interpolating between a control point in va i ue> arid tne conversion table generated by the first con- 

a halftone region and starting points on the high brightness 15 version table generating means, a brightness value of the 

side and on the low brightness side. pixel oblamed after backlight correction, and 

According to the third aspect of the invention, a computer brightness value comparing means for comparing a 

readable memory which stores an image processing program brightness value of each pixel - m image data of input ^ 

for controlling an image processing system which conducts wUh the shadow fegion brightness valuCj and when the 

necessary correction processing on digital image data, the 2Q brightness value of the targetpixe l is lower than the shadow 

image processing program comprises the steps of region brightness value> taking the brightness value of the 

among correction patterns set corresponding to kinds of target pixel as a tightness value to be obtained after the 

color fogs, selecting the correction pattern suitable for correction and when the brightness value of the target pixel 

correction of input image by the operation of an operator, ^ higher than the sna dow region brightness value, activating 

obtaining a correction amount indicative of an appropriate 25 the backlight correction characteristics calculating means to 

degree of correction on color fog, calculate a brightness value to be obtained after the correc- 

generating a tone curve of RGB based on the correction tion. 

pattern selected at the correction pattern selecting step and According to the fifth aspect of the invention, a digital 

the correction amount obtained at the correction amount image data correcting method in an image processing system 

obtaining step, and 30 which conducts necessary correction processing on digital 

performing table conversion on image data of the input image data, comprises the steps of 

image according to the tone curve generated at the tone extracting a shadow region brightness value which is a 

curve generating step to conduct color conversion of all brightness value of a low brightness pixel from image data 

pixels of the image data of j nput image, 

According to the fourth aspect of the invention, an image 35 obtaining a backlight correction amount indicative of an 

processing system which conducts calculating, from an appropriate degree of correction on backlight input image, 

RGB value of a pixel, a brightness value of the pixel, generating a backlight correction table characterized by, 

wherein the shadow region brightness value extracting based on the shadow region brightness value extracted at the 

means causes the RGB brightness value converting means to shadow region brightness value extracting step and the 

extract a shadow region brightness value of a desired low ^ back ii ght correction amount obtained at the backlight cor- 

brightness pixel. rection amount obtaining step, not correcting a pixel whose 

The backlight correction table generating means may brightness value falls in the range between "0" and the 

comprise shadow region brightness value and correcting a pixel whose 

parameter calculating means for calculating a parameter brightness value is higher than the shadow region brightness 

for use in correction based on the backlight correction 45 value so as to increase the brightness value, and 

amount stored in the backlight correction amount storing necessary correction processing on digital image data, 

means, comprises 

first conversion table generating means for generating a shadow region brightness value extracting means for 

conversion table by using the parameter calculated by the 5o extracting a shadow region brightness value which is a 

parameter calculating means, and brightness value of a low brightness pixel from image data 

second conversion table generating means for generating of input image, 

the backlight correction table based on the conversion table backlight correction amount storing means for storing a 

generated by the first conversion table generating means and backlight correction amount indicative of an appropriate 

the shadow region brightness value extracted by the shadow 55 degree of correction on backlight input image, 

region brightness value extracting means, backlight correction table generating means for generat- 

the parameter calculating means calculating spline control i ng a backlight correction table characterized by, based on 

point coordinates based on the backlight correction amount, the shadow region brightness value extracted by the shadow 

aQ d region brightness value extracting means and the backlight 

the first conversion table generating means calculating a 60 correction amount stored in the backlight correction amount 

spline curve based on the spline control point coordinates. storing means, not correcting a pixel whose brightness value 

The backlight correction table generating means may falls in the range between "CT, and the shadow region 

comprise brightness value and correcting a pixel whose brightness 

parameter calculating means for calculating a parameter value is higher than the shadow region brightness value so 

for use in correction based on the backlight correction 65 as to increase the brightness value, and 

amount stored in the backlight correction amount storing LUT converting means for performing table conversion 

means, on image data of the input image based on the backlight 
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correction table generated by the backlight correction table accompanying drawings of the preferred embodiment of the 

generating means to conduct color conversion processing of invention, which, however, should not be taken to be limi- 

all pixels of the image data. tative to the invention, but are for explanation and under- 

The image processing system may further comprise RGB standing only, 

brightness value converting means for 5 i n the drawings: 

performing table conversion on image data of the input FIG. 1 is a block diagram showing a constitution of an 

,rnage based on the backlight correction table generated a ^ ^ , tem accordi , 0 an embodiment of tne 

the backlight correction table generating step to conduct * 

color conversion processing of all the pixels of the image P D inven on - 

data. 1Q FIG. 2 is a block diagram showing a constitution of a tone 

The backlight correction table generating step comprises curve generating unit of the present embodiment, 

the steps of FIG. 3 is a flow chart showing a flow of the processing in 

calculating a parameter for use in correction based on the the color fog correcting method of the embodiment, 
backlight correction amount stored in the backlight correc- FIG. 4 is a schematic view for use in describing genera- 
tion amount storing means, 15 tion processing of a color fog correction table according to 

generating a conversion table by using the parameter the embodiment, 

calculated at the parameter calculating step, and piG. 5 is a view showing a data example of a correction 

generating the backlight correction table based on the pattern storing unit of the embodiment, 

conversion .table generated at the conversion table general- FIG. 6 is a schematic view showing a constitution 

ing step and the shadow region brightness value extracted by « n ^ m i r * ■ -i ■ r 

,i , j , . , & 4 J 20 example ot a correction parameter specifying device tor use 

the shadow region brightness value extracting means, • *u l j- * r j & 

*u ♦ c r un- u. / 4 ! . ui the embodiment. 

the step of generating a backlight correction table based , . . 

on the conversion table include the steps of . FIG " 7 15 a block snowin S a institution of an 

comparing a brightness value of each pixel in image data "ff Pressing system according to another embodiment 

of input image with the shadow region brightness value, ot the P resent invention. 

determining a brightness value of the target pixel as a FIG. 8 is a block diagram showing a constitution of a 

brightness value to be obtained after the correction when the second conversion table generating unit of the embodiment, 

brightness value of the target pixel is lower than the shadow FIG - 9 is an illustration for use in describing a y correction 

region brightness value, and curve obtained by the control point. 

calculating a brightness value of a target pixel to be 30 F IG. 10 is a flow chart showing a flow of the processing 

obtained after the backlight correction with reference to the in a backlight correction method according to the embodi- 

brightness value of the target pixel, the shadow region meet. 

brightness value, and the conversion table generated at the FIG. 11 is a schematic view for use in describing the 

conversion table generating step when the brightness value processing for generating a backlight correction table from 

of the target pixel is higher than the shadow region bright- 35 a first conversion table according to the embodiment, 

ness value. FIG. 12 is an illustration for use in describing a conver- 

According to the sixth aspect of the invention, a computer sion characteristic of the backlight correction table gener- 

readable memory which stores an image processing program a ted by the embodiment. 

for controlling an image processing system which conducts FIG. 13 is a view showing an example of a look-up table, 

necessary correction processing on digital image data, the 40 FIG. 14 is a block diagram showing a constitution of the 

image processing program comprises the steps of conventional image processing system for correcting the 

extracting a shadow region brightness value which is a color fog of an image, 

brightness value of a low brightness pixel from image data FIG. 15 is a block diagram showing a constitution of the 

of input image, conventional image processing system for performing the 

obtaining a backlight correction amount indicative of an 45 backlight correction of an image, 

appropriate degree of correction on backlight input image, FIG. 16 is a view for use in describing a conversion 

generating a backlight correction table characterized by, characteristic according to a y correction, 

based on the shadow region brightness value extracted at the DESCRIPTION OF THE PREFERRED 

shadow region brightness value extracting step and the EMBODIMENT 

backlight correction amount obtained at the backlight cor- 50 

rection amount obtaining step, not correcting a pixel whose The preferred embodiment of the present invention will 

brightness value falls in the range between "0" and the be discussed hereinafter in detail with reference to the 

shadow region brightness value and correcting a pixel whose accompanying drawings. In the following description, 

brightness value is higher than the shadow region brightness numerous specific details are set forth in order to provide a 

value so as to increase the brightness value, and 55 thorough understanding of the present invention. It will be 

performing table conversion on image data of the input obvious, however, to those skilled in the art that the present 

image based on the backlight correction table generated at invention may be practiced without these specific details. In 

the backlight correction table generating step to conduct other instance, well-known structures are not shown in detail 

color conversion processing of all the pixels of the image m order t0 unnecessarily obscure the present invention, 

data. 60 A principal of color fog correction in an image, according 

Other objects, features and advantages of the present t0 the P resent invent i°n, is described first, 

invention will become clear from the detailed description Witn reference to FIG. 3 showing a flow of the processing 

given herebelow. in correction of color fog of an image according to the 

BRIEF DFSriilPTTON OF THF nRAWTNf^ prcSeDt mvention > the °P erator first confirms an input image 

BRIEF DESCRIPTION OF THE DRAWINGS 65 5y a monitor or the ^ and ^ hc{s QQQ paUem tQ be 

The present invention will be understood more fully from executed from the correction patterns prepared beforehand 

the detailed description given herebelow and from the (Step 301). 
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There are several patterns in the unfavorable color con- for storing correction patterns for correcting color fog in an 

dition of an image, including green fog in a fluorescent light, input image, a correction pattern specifying unit 30 for an 

yellow fog in an electric light, red fog in a snow scene, and operator to specify the correction pattern, a correction 

blue fog by light coming through a window facing north. amount storing unit 40 for storing the correction amount of 

These are caused not only by the type of the light source but 5 color fo g> a correction amount specifying unit 50 for an 

also by the characteristics of the photographic film used and operator to specify the correction amount, a tone curve 

the CCD. The present invention holds tone curve control generating unit 60 for generating the tone curve data of RGB 

parameters for each of these unfavorable patterns. Correc- 011 the basis of the data stored m the correction pattern 

tion pattern selected in Step 301 means the combination of stonn S 111111 20 and the corre ction amount stored in the 

these control parameters. 10 correctlon amount st0 ™g ™t 40, an LUT storage buffer 70 

VT A . c i_ for storing the generated tone curve data, an LUT converting 

Next, the operator determines the extent of correction by on e f t , , . iL . , .° 

. r . - r r /cw Aft J unit 80 tor performing a table conversion on the image data, 

specifying the amount of correction (Step 302). Alter a , 4 r 4 . u *f na r i_ i j* « * j ? 

r ± , & . r n i_* ■ j and an output image buffer 90 for holding output data. FIG. 

control parameter for the same correction pattern is obtained A u .f , t . . . . r ^ . j • 

/o* ia^ .l nnn, • i if j *u u ■ c 1 shows the characteristic components of the embodiment 

(Step 303), the RGB tone curve is calculated on the basis of u. „ j *u i * * u ™ 

* ± v , j * 4 /cu 1C only, and the other general components are not shown 
the control parameter and the correction amount (Step 304), 15 J . , ° ^ . 

y . . . • j * therein. It is needless to say that the system includes further 

and color conversion processing on an input image data on _ c tl _ it _- 

lL , . f it _ * , 4 6 . i . • , ■ r i components for executing other smoothing operations, 

the basis of the tone curve data thus obtained is performed . , ,. , ir u ~. ^ , , ~ , . , ' 

in«\ including backlight correction to be described herein later, 

^ " '* and other components for executing other processing. 

FIG. 5 shows an example of the correction pattern men- CT/ - n • ™ u «•« *• p ♦ 

Vi r • ^ -?n FIG. 2 is a block diagram showing a constitution of a tone 

tioned above. In a data table 501 tor correction patterns as zu , 4 - ™ A .„ . ° , . ri „ ~ 4 

^ , curve generating unit 60. As illustrated in FIG. 2, the tone 

ilhstnted, each item of the unfavorable pattern such as curye ati unit 60 flutes a highlight correction 

green fog m a fluorescent light and its corresponding tone amQunt cakulati unit 61 for calculating me mmetiaa 

curve control parameter 502 for correcting the unfavorable „ f - . u- ur u* • * *l t>/^£ *u u ■ * 

^ . t _ & amount in each highlight region of the RGB on the basis of 

condition are registered. The tone curve control parameter , . . , - f . ~" ~T> ♦* „ f ■ in ^ 

• i , , . • 1 1* i /< i\ i ✓ f . i -><; the data stored m the correction pattern stonng unit 20 and 
502 includes data on highlight (hi), half tone (m), shadow z:> # . _ a „ . f , . . f 

, , N .„ , . f^^ v / . P , v t the correction amount stored in the correction amount stor- 

(sd), as illustrated in FIG. 5. Each piece of data has three • „ . f Afk n u«ift««-«™ ™ * i i *• a 

\'L , ^ v t £ „ ,„ . mg unit 40, a halt tone correction amount calculating unit 62 

RGB control parameters 503. For example, hi is repre- fof calculatin the correction amount of each half tone 

sented by the combmation of (Rh, Gh, Bh). region of the RGB? a shadow correction amount calculatmg 

An example of tone curve control by the use of highlight, unit 63 for calculating the correction amount of each shadow 
half tone, and shadow as parameters is described with regkm of RGBj a tone curve data calculating unit 66 for 
reference to FIG. 4. A tone curve is controlled by the calculating the tone curve data on the basis of the above- 
specified correction amount (grad) and parameters (hi), (m), mentioned three correction amounts, a straight line gener- 

ating module 64, and a curve generating module 65. 

In the example shown in FIG. 4, the M control point 404 35 In tnus coasti tuted image processing system, the operator 

* controlled by the data of half tone (m) and (grad), and used first selects a correc tion pattern to be adopted to an image of 

for generating a half tone correction curve 401. The HL tne mput image buffer 10 by the correction pattern specify- 

control point 406 is controlled by the data of the highlight ing unit 30 aad inputs ^ appropriate color fog correc tion 

(hi) and (grad) and the SD control point 405 is controlled by amount into the correc tion amount storing unit 40 by use of 

the data of the shadow (sd) and (grad). The HL control point 4o the correction amount specifying unit 50. As for the color 

406 and the SD control point 405 are used to generate a fog correction am ount, a predetermined value may be held 

highlight shadow correction curve 402. m me correction amount storing unit 40 beforehand. 

In the half tone correction curve 401, the M control point ^ correction pattern spe cifyiag unit 30 includes, for 

404 on the tone curve moves upward when the correction example, a monitor for displaying an image, and an interface 

amount of the halftone is«+",and it moves downward when 45 for the correct i 0 n pattern with a mouse or other 

it is An interpolation curve interpolates smoothly poin ti ng device . Fia 6 shows a constitutional example for 

between the starting point (0,0) of the tone curve on the side rea li z i ng the correction pattern specifying unit 30 and the 

of low bnghtness, the M control point 404, and the starting correc tion amount specifying unit 50. The correction pattern 

point (255, 255) of the tone curve on the side of high specifying means 601 displayed on the CRT monitor 604 

bnghtness, thereby generating a tone curve. 5Q shows the items such ^ fog in a fluorescent light, 

In the highlight shadow correction curve 402, when the yellow fog in an electric light, red fog in a snow scene, and 

highlight correction amount and the shadow correction blue fog in a light from a window facing north. The operator 

amount are "+" or the HL control point 406 and the SD specifies a desired correction pattern by operating a mouse 

control point 405 move as illustrated. A straight line inter- 603. The correction amount specifying means 602 also 

polates between the HL control point 406 and the SD control 55 displayed on the CRT monitor 604 shows a slider bar for 

point 405. specifying the extent of correction. The operator specifies a 

As a result, the half tone correction curve 401 is synthe- desired correction amount by operating the mouse 603. 

sized with the highlight shadow correction curve 402, gen- xh e tone curve generating unit 60 obtains the tone curve 

erating a synthetic curve 403. The above-mentioned pro- data of the corrected pattern specified by the operator 

cessing is performed on the tone curve of every RGB by use 60 through the above mentioned correction pattern specifying 

of the RGB control parameter 503 illustrated in FIG. 5. umt 30, from correction pattern storing unit 20, and similarly 

FIG. 1 is a block diagram showing a constitution of an further obtains the correction amount specified by the opera- 
image processing system for realizing the above-mentioned tor through the correction amount specifying unit 50, from 
color fog correction. the correction amount storing unit 40, thereby calculating 

With reference to FIG. 1, the image processing system of 65 the tone curve data of the RGB by combining these data. The 

the embodiment includes an input image buffer 10 for calculated tone curve data is supplied to the LUT storing 

holding input image data, a correction pattern storing unit 20 buffer 70. 
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Hereafter, the calculating processing of the tone curve correction point 404 is the half point in the middle of the 
data by the tone curve generating unit 60 is described in brightness of the tone curve. In the example of FIG. 4, the 
detail, using the case in which the data illustrated in FIG. 5 M control point 404 is defined as (128, 128). When the half 
are used as control parameters as an example. In this tone correction amount M is "+", the M control point 404 
description, it is assumed that the selection of a correction 5 moves upward, and when it is it moves downward, 
pattern (Step 301 in FIG. 3) and specification of the correc- An example of the movement of the M control point 404 
tion amount (Step 302) have already been completed by the is described hereafter. Assuming that the R component of the 
operator. half tone correction amount M is Mr, the M control point 

The highlight correction amount calculating unit 61 first 404 of the R tone curve moves from (128, 128) to (128, 
obtains the highlight control parameter hi as the control 10 128+Mr). More specifically, when Mr=100, the M control 
parameter from the correction pattern storing unit 20. The point 404 on the R tone curve moves from (128, 128) to 
control parameter hi is held in the format of the RGB control (128, 228). Similarly, the M control point 404 on the G tone 
parameter 503, and defined as (Rh, Gh, Bh) (Step 303). curve and B tone curve moves respectively for each corn- 
Next, the unit 61 obtains the correction amount (grad) from ponent of the correction amount. 

the correction amount storing unit 40. The highlight correc- 15 As a result, when the half tone correction amount is "+", 
tion amount is calculated on the basis of the correction the tone curve of each RGB component becomes a curve 
amount (grad) and the control parameter hi. The highlight expanded upward as illustrated in the conversion character- 
correction amount HL=(HLr,HLg,HLb) is obtained by the istic 36. In the actual calculation, the curve generating 
following expressions (2), (3), and (4). module 65 is activated, to generate a curve by curve inter- 

20 polation such as spline interpolation or other interpolation 
for the point (0, 0), the M control point 404, and the point 
HLr-Rhx&ad) (2) ( 2 55, 255). The only requirement here is that the starting 

iiLg=Gkx(grad) (3) points (0, 0) and the point (255, 255) on the tone curve and 

the M control point 404 are smoothly connected by the curve 
HLb~Bhx(grad) (4) 25 interpolation and any interpolation function can be used for 

the curve interpolation. 

Similarly, the halftone correction amount calculating unit Next? the highlight shadow correction curve 402 is cal- 
62 calculates the half tone correction amount. Assuming that culated on the basis of the highlight correction amount HL 
the half tone parameter m is (Rm, Gm, Bm), the half tone and the sna dow correction amount SD. The HL control point 
correction amount M-(Mr, Mg, Mb) can be obtained by the 30 40 6 is the control point positioned on the higher brightness 
following expressions (5), (6), and (7). side of the tone curve when the highlight correction amount 

HL is "+", it is assumed that the HL control point 406 moves 

Mn*Rmx( ad) <S\ ^ 255 ' ^ t0Wafds (°- 255 )' WheD the hi g hli S ht 

X ^ sra ' ^ ^ correction amount HL is "-" it is assumed that the HL 

35 

Mg=Gm*{grad) (6) control point 406 moves from (255, 255) towards (255, 0). 

The SD control point 405 is the control point positioned on 
Mb~Bmx(grad) (7) the lower brightness side of the tone curve. When the 

shadow correction amount SD is "+", it is assumed that the 
The shadow correction amount calculating unit 63 calcu- S D control point 405 moves from (0, 0) towards (255, 0). 
lates the shadow correction amount. Assuming that the 40 WheQ ^ shadow correct ion amount SD is it is 
shadow parameter sd is (Rs, Gs, Bs), the shadow correction assumed that the SD control point 405 moves from (0, 0) 
amount SD=(SDr, SDg, SDb) is obtained by the following towards (0, 255). 

expressions (8), (9), and (10). ^ example of the movemen t of the SD control point 405 

45 and the HL control point 406 is described hereafter. Assum- 
SDr=Rsx(grad) (8) tnat tne ^ component of the shadow correction amount 

SD is SDr, when SDr>0, the SD control point 405 on the R 
SDg=Gs*{gwd) (9) tone curve moves from (0, 0) to (SDr, 0). When SDr<0, the 

SD control point 405 on the R tone curve moves from (0, 0) 
SDb-Bsx(grad) (io) ^ tQ ^ _ SDr ^ A^^g ^at the R component of the high- 

lit is to say, each correction amount per unit correction ^ l correction amount HL is HLr, when HLr>0 the HL 
amount is written in the correction pattern storing unit 20, co ^ c °] I^Jf R ^ ^ m ™ cs from ( 255 ' 255) 
and the flexibility in correction is enhanced by multiplying t0 ( 2 55-HLr, 255). When HLr<0, the HL control point 406 
the unit correction amount by the data stored in the correc- °" lh ^ T * |°ne ™™ moves fro ™ ( 255 > 255 > t0 ( 255 ' 
tion amount storing unit 40 at each correction amount 55 255+I ^> ^ S J? contro1 P°»* and the HL contro j 
calculating unit P oint ° on tne " tone curve and B tone curve are moved 

Next, the tone curve data calculating unit 66 calculates the similarly, 
tone curve data on the basis of the above-mentioned three The straight line generating module 64 is activated to 
correction amounts (Step 304). An example of the tone curve obtain a highlight/shadow correction curve 402 for the 
data calculation is illustrated in FIG. 4. Here, the RGB data 60 control points set as mentioned above by the straight line 
are defined as 8 bits and the pixel value is defined as the interpolation. 

value in the range of 0 to 255. The starting point of the tone The tone curve data calculating unit 66 then synthesizes 
curve on the side of low brightness is (0, 0), and the starting the two tables generated as mentioned above. Assuming that 
point of the tone curve on the side of high brightness is (255, the half tone correction curve 401 is stored in the Table A[], 
255) 65 and the highlight/shadow correction curve 402 is stored in 

First, the half tone correction curve 401 is calculated on the Table B[], the synthesized curve 403 can be obtained 
the basis of the half tone correction amount M. The M using the following expression (11). 
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of the low brightness pixel of the image is extracted and 
Tabie[i) = TabieB[TabieA[i]] {i = o, l, 2, ... 255) (11) defined as the brightness value of the shadow region. In 

addition, assuming, for example, that the number of pixels 
equaling of all the pixels is Na, the brightness value of the 

The conversion characteristic 409 is shown in FIG. 4 as 5 pixel having the Na-th lowest brightness value may be 
an example of combined curve. The synthesized curve 403 adopted as the brightness value of the shadow region, 
is calculated separately for each RGB. The synthesized Next, the operator specifies the backlight correction 
curve 403 obtained by calculation is output to the LUT amount (Step 1002). The half tone correction parameter is 
storing buffer 70 as the tone curve data for RGB. calculated from the specified backlight correction amount 

After the table of the tone curve data thus created is stored 10 (Step 1003). Examples of the half tone control parameters 
in the LUT storing buffer 70, the LUT conversion unit 80 include the y values and n control points on the spline curve, 
reads the RGB image data sequentially from the input image Alternatively, an appropriate value may be stored in the 
buffer 10, and performs the conversion on the data of each system in advance as the backlight correction amount and 
component of the RGB with reference to the table of the use it when calculating the half tone correction parameter, 
corresponding component stored in the LUT storing buffer is Next, the half tone parameter thus calculated is used to 
70 (Step 305). The values of the data after the table con- generate the first conversion table for use in correcting 
version are stored in the output image buffer 90. backlight (Step 1004). Here, the first conversion table is 

As described above, the color fog correction processing described. FIG. 11 shows an example of the first conversion 
by the image processing system of the present invention table. The characteristic 40 of the first conversion table as 
enables complicated smoothing that has been difficult so far, 20 shown in FIG. 11 is a y correction curve that uses the y value 
such as smoothing according to the light source color and as the half tone parameter, and is expressed by the following 
smoothing in a snow scene, by preparing the correction expression, 
patterns in accordance with the various unfavorable condi- 
tions of an image and performing data correction by table 

conversion. 25 Y'^xW (13) 

Further, it can perform correction for the color foe caused ~ . , . . , . ... 

by not only color variances of the light source but also the ^ characteristic curve has a conversion characteristic that 
film sensitivity and the exposure processing, by registering ureases ** brightness in the half tone region The coeffi- 
proper correction patterns. cient c 15 a 0011513,11 that 18 determined by the range of 

Color fog correction by the image processing system of 30 bngh^ss to be input. Since backlight correction requires an 
the present invention adopts such an intuitive specifying Mcreas6 u 1Q ,he ™ lue brightness in the half region, the 
method that proper smoothing can be made by only speci- Y value here is always less than 1.0. 
fying a correction pattern and a correction amount, not ^ exam P lc of ' he method , s of «»wtmg a backlight 
requiring many adjustment parameters. As a result, the correction amount G to the Y value requires to prepare a table 
operation's time requirements are reduced, thereby enhanc- 35 that sh ™ s correspondence between backlight correction 
ing efficiency and reducing operator manhours. In addition, amoun 1 t G and \ value t0 be "f* for conversion. Another 
the system provides the advantage that the operation does exam P le 18 *P calculate the * value m , such a manner that M 
not require skill and experience, thus allowing even a appropriate bnghtness value X of half tone can be converted 
less-experienced operator to perform smoothing as desired. into a bn f htness ^.P^ th * convelsloa P ro " 

Next, the principle of the backlight correction according 40 M u an example FIG. 9 shows the curve that is 

to the present invention is described. obtalned when the 00111101 P° int 60 has ohan S ed from A to 

With reference to FIG. 10 showing a flow of the process- B : K the hidf tc T P arameter represents n control points (xl, 
ing of the backlight correction according to the present x2 ' x • ; ' > on , the s P hne curve ' a curve 0311 be obtained b y 
invention, the lower brightness portion is first extracted from Performing spline interpolation on the respective control 
an input image on the screen and its brightness is stored as 45 P omts - . 

the shadow brightness value (Step 1001). , Next - a backh gnt correction table is generated by use of 

In order to extract the shadow brightness value, a histo- ' be ^IZ^" J™*" 1 ™ value extracted in Step 1001 
gram of the brightness is created. The brightness herein ( Ste P 100 f> F ' G ' l2 * h ™ s an «»«nple of backlight cor- 
means the numerical value showing the brightness of the ™i table. According to the characteristic 1204 in the 
RGB pixel. One method of obtaining the brightness from the so back u llght correotl °° table > the input and output from the 
RGB value is to use the Y value of the CIE-XYZ value. brightness 0 to the shadow region brightness value 1203 are 
More specifically, assuming that the RGB value is the NTSC th _ e ^ 1116 brl g h « ness increases gradually starting at the 
signal, the Y value can be obtained by the following expres- ^adow region brightness value 1203, and the input and 
sion (12). output become the same again when the brightness is 

s5 maximum. 

Following is an example of calculation to obtain the 
r-o.299><R+o.287xG+o.ii4 X fi (12) characteristic 1204 of the backlight correction table. Assum- 

Additionally, such values of the average value of R, G, J* that the characteristic of the fi "t conversion table above 

and B, or the maximum value of R, G, and B may be adopted 1S ' 

as the brightness Y of its pixel 60 

A histogram is obtained by scanning the image data from v-f(Y) (14) 
the end and incrementing the value of the array hist[Y] at the 

brightness Y value. Alternatively, in order to shorten the the characteristic 1204 of the backlight correction table can 

processing time, a histogram may be created by searching be expressed in the expressions (15), (16), and (17), as 

for the pixels in appropriate intervals, for example, every 65 follows. Here, the brightness value Y of an image is assumed 

several pixels, instead of searching for all. In reference to the to be between 0 and 255, and the brightness value after 

low brightness area of the created histogram, the pixel value conversion is represented by F(Y): 
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(When Y<Low) 

F(Y)=Y 

(When y>Low) 



(255 - Low) 
F{Y) = x + Low 



(15) 



(16) 



10 



G(Y) = 



255 



(255 - Low) 



x (V - Low) 



(17) 



20 



25 



35 



40 



As shown in FIG. 11, the characteristic 1102 of the 
backlight correction table has a characteristic which is 
similar to the results that are obtained by mapping the 
Y'=f(Y) curve, as shown by the characteristic 1101 of the 
first conversion table, to the range from (Low, Low) to 
(255,255). 

Generally speaking, since the input backlight portion 
1201 is distributed in the vicinity of the shadow region 
brightness value, intensifying the contrast in this region 
leads to an improvement in image quality. The characteristic 
1204 of the backlight correction table shown in FIG. 12 
indicates that the input backlight portion 1201 is converted 
to the output backlight portion 1202, constantly intensifying 
the contrast in the backlight portion. 

Finally, the backlight correction table thus obtained is 
stored as the lookup table (LUT 1300 shown in FIG. 13), 
which is then used for color-converting of all the pixel 
values (Step 1006). 

FIG. 7 is a block diagram showing a constitution of an 
image processing system that implements the backlight 
correction as described above. 

With reference to FIG. 7, the image processing system of 
the embodiment includes an input image buffer 110 for 
holding input image data, an RGB brightness value convert- 
ing unit 120 for calculating the brightness value from the 
RGB value, a shadow region brightness value extracting unit 
130 for extracting the brightness value of the shadow region 
from an image, a backlight correction amount storing unit 
140 for storing the backlight correction amount, a backlight 
correction table generating unit 150 for generating a back- 
light correction table on the basis of the backlight correction 45 
amount and the shadow region brightness value, an LUT 
storing buffer 160 for storing the conversion table, an LUT 
converting unit 170 for performing lookup table conversion 
on an image, an output image buffer 190 for holding an 
output image, and a noise removing filter 180. The backlight 50 
correction table generating unit 150 includes a half tone 
correction parameter calculating unit 152 for calculating the 
Y value from the backlight correction amount as a half tone 
correction parameter, a first conversion table generating unit 
153 for generating the first conversion table on the basis of 55 
the y value thus calculated, and a second conversion table 
generating unit 151 for generating the backlight correction 
table on the basis of the shadow region brightness value and 
the first conversion table. FIG. 7 shows the characteristic 
components of the embodiment only, and the other general 60 
components are not shown therein. It is needless to say that 
the system includes further components for executing other 
smoothing operations, including color fog correction 
described above, and other components for executing other 
processing. 

FIG. 8 is a block diagram showing a constitution of the 
second conversion table generating unit 151 of the backlight 
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correction table generating unit 150. As shown in FIG. 8, the 
second conversion table generating unit 151 includes a 
representative brightness generating unit 154, a shadow 
pixel comparing unit 156, a backlight correction character- 
istic calculating unit 155, a table referencing unit 157, and 
a table writing unit 158. 

In thus constituted image processing system, the shadow 
region brightness value extracting unit 130 extracts the 
shadow region brightness value on the basis of the image 
data input into the input image buffer 110 (Step 1001 in FIG. 
10). More specifically, a histogram for brightness data is 
created by converting the RGB data to brightness data by the 
RGB brightness value converting unit 120. Alternatively, a 
histogram may be created by searching an image while 
obtaining every several pixels instead of searching for all the 
pixels, for faster histogram calculation. Next, from the 
histogram thus obtained, the brightness value of the pixel 
having the lowest brightness in the image is extracted as the 
shadow region brightness value. As described above, it is 
also possible that, by regarding the number of pixels equal- 
ing a% of all as Na, the pixel having the Na-th lowest 
brightness value may be output as the shadow region bright- 
ness value. 

After the correction amount is input into the backlight 
correction amount storing unit 140 by the operator (Step 
1002), the backlight correction table generating unit 150 
calculates the backlight correction table using the extracted 
shadow region brightness value and the input backlight 
correction amount (Step 1003 to 1005), and inputs the 
results into the LUT storing buffer 160. In the backlight 
correction table generating unit 150, the halftone correction 
parameter calculating unit 152 first calculates the half tone 
correction parameter using the backlight correction amount 
(Step 1003). 

When calculating the y value as the half tone parameter, 
the half tone parameter calculating unit 152 can store the 
table showing correspondence between backlight correction 
amount G and y value in the memory beforehand as 
described above, and refer to the table to determine the y 
value according to the input or otherwise calculate the y 
value by assuming such y correction that will allow an 
appropriate brightness value X of half tone to be converted 
to the brightness value (X+G). When calculating the spline 
control points as the half tone parameter, this unit can store 
in the memory beforehand the table showing correspon- 
dence between backlight correction amount G and n control 
points, and refer to the table to determine the control points 
according to the input. 

The first table generating unit 153 generates a correction 
curve using the half tone parameter obtained by calculation, 
and stores it in the LUT storing buffer 160 (Step 1004). 
Similarly to the LUT 1300 as shown in FIG. 13, the LUT 
storing buffer 160 can store data as the combinations of input 
brightness Y and output brightness F (Y). When the half tone 
parameter is the y value, a y correction curve is generated 
and stored in the LUT storing buffer 160. When the half tone 
parameter is the spline control points, a correction curve is 
generated by performing spline interpolation using the con- 
trol points and stored in the LUT storing buffer 160. 

The second conversion table generating unit 151 gener- 
ates a final backlight correction table using the shadow 
brightness value and the data of the correction curve stored 
in the LUT storing buffer 160 and stores it in the LUT 
storing buffer 160 (Step 106). 

Next, generation of the backlight correction table by the 
second conversion table generating unit 151 is described in 
detail. 
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As described above, the second conversion table gener- 
ating unit 151 includes a representative brightness generat- 
ing unit 154, a shadow pixel comparing unit 156, a backlight 
correction characteristic calculating unit 155, a table writing 
unit 158, and a table referencing unit 157. First, as the 5 
representative brightness to be stored in the LUT, the 
representative generating unit 154 generates the brightness 
value Y by incrementing by 1 from 0 until the maximum 
value of brightness is reached. Then, the shadow pixel 
comparing unit 156 compares the brightness value Y and the 10 
shadow pixel value Low. When Y is smaller than Low, the 
table writing unit 158 stores the Y value as is at the 
predetermined address in the LUT storing buffer 160. When 
Yis greater than Low, the backlight correction characteristic 
calculating unit 155 calculates the value after backlight is 
correction concerning Y and Low. 

The backlight correction characteristic calculating unit 
155 calculates the value after backlight correction on the 
basis of the brightness value Y and the shadow region 
brightness value Low, using the above-mentioned expres- 20 
sions (16) and (17). More specifically, first g(Y) is calculated 
using the expression (17), and next the brightness value F 
(Y) after backlight correction is calculated using the expres- 
sion (16). The expressions (17) and (18) can be obtained 
easily by combining a subtracting means, a multiplying 25 
means, and a dividing means. In this operation, f(Y) is 
referenced by the table referencing unit 157 and the LUT 
storing buffer 160. This f(Y) represents the result of con- 
version by the first conversion table conversion table that is 
already stored in the LUT storing buffer 160. 30 

F(Y) thus obtained as mentioned above is stored in the 
predetermined address in the LUT buffer 160 by the table 
writing unit 158. 

After the backlight correction table is stored in the LUT 
storing buffer 160, the LUT converting unit 170 reads the 35 
RGB image data sequentially, and performs the conversion 
on the data of each component of the RGB with reference to 
the table of the corresponding component stored in the LUT 
storing buffer 160 (Step 1006). The values of the data after 
table conversion are stored in the output image buffer 190. 40 

Since backlight correction largely enhances the contrast in 
the backlight portion, even noise hidden in that portion is 
enhanced as well occasionally. If this happens, an output of 
better image quality can be obtained by performing subse- 
quent treatment by the noise removing filter 180. One 45 
example of noise removing filter that is effective in subse- 
quent treatment is a median filter. Median filters are gener- 
ally used for removing granular noise. Noise removal by use 
of a median filter is performed as follows. First, the neigh- 
borhood of pixels is searched and a histogram of brightness 50 
values of the neighborhood pixels is prepared. A value that 
represents the median is obtained from the histogram, which 
is adopted as the new value of pixel. 

As described heretofore, the image processing system of 
the present invention does not correct pixels in the range 55 
between the brightness value 0 and the shadow region 
brightness value. Instead, it uses a tone curve that rises with 
the shadow region as its starting point, thereby achieving a 
feature that corrects halftone pixels having greater bright- 
ness value than the shadow region brightness value to a 60 
greater brightness. By this, this system provides the advan- 
tageous capability of correcting backlight without reducing 
contrast. 

The system is also effective in increasing the quality of 
output images by incorporating a noise removing filter. 65 

Although the invention has been illustrated and described 
with respect to exemplary embodiment thereof, it should be 



836 

18 

understood by those skilled in the art that the foregoing and 
various other changes, omissions and additions may be 
made therein and thereto, without departing from the spirit 
and scope of the present invention. Therefore, the present 
invention should not be understood as limited to the specific 
embodiment set out above but to include all possible 
embodiments which can be embodies within a scope encom- 
passed and equivalents thereof with respect to the feature set 
out in the appended claims. 
What is claimed is: 

1. An image processing system which conducts necessary 
correction processing on digital image data, comprising: 

correction pattern storing means for storing correction 
patterns set corresponding to kinds of color fogs; 

correction pattern selecting means for selecting said cor- 
rection pattern suitable for correction of an input image 
among said correction patterns stored in said correction 
pattern storing means through the operation of an 
operator; 

correction amount storing means for storing a correction 
amount indicative of an appropriate degree of correc- 
tion on color fog; 

tone curve generating means for generating a tone curve 
of RGB based on said correction pattern selected by 
said correction pattern selecting means and said cor- 
rection amount stored in said correction amount storing 
means; and 

LUT converting means for performing table conversion 
on image data of said input image based on said tone 
curve generated by said tone curve generating means to 
conduct color conversion processing of all the pixels of 
image data, and 
wherein said tone curve generating means comprises: 
highlight control amount calculating means for calcu- 
lating a control amount of a highlight region in each 
component of RGB based on said correction pattern 
and said correction amount, 
half tone control amount calculating means for calcu- 
lating a control amount of a half tone region in each 
component of RGB based on said correction pattern 
and said correction amount, 
shadow control amount calculating means for calculat- 
ing a control amount of a shadow region in each 
component of RGB based on said correction pattern 
and said correction amount, 
tone curve calculating means for calculating said tone 
curve of each component of RGB based on the three 
kinds of control amounts calculated by said three 
kinds of control amount calculating means, 
a straight line generating means for use in the tone 
curve calculating processing by said tone curve 
calculating means to conduct straight line interpola- 
tion between a control point in a high brightness 
region and a control point in a low brightness region, 
and 

a curve generating means for use in the tone curve 
calculating processing by said tone curve calculating 
means to conduct curve interpolation for smoothly 
interpolating between a control point in a half tone 
region and starting points on the high brightness side 
and the low brightness side. 

2. Digital image data correcting method in an image 
processing system which conducts necessary correction pro- 
cessing on digital image data, comprising the steps of: 

among correction patterns set corresponding to kinds of 
color fogs, selecting said correction pattern suitable for 
correction of an input image by the operation of an 
operator; 
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obtaining a correction amount indicative of an appropriate 
degree of correction on color fog; 

generating a tone curve of RGB based on said correction 
pattern selected at said correction pattern selecting step 
and said correction amount obtained at said correction 5 
amount obtaining step; and 

performing table conversion on image data of said input 
image according to said tone curve generated at said 
tone curve generating step to conduct color conversion 
of all pixels of the image data, and 10 

wherein said tone curve generating step comprises the 
steps of: 

calculating a control amount of a highlight region in 
each component of RGB based on said correction 
pattern and said correction amount, 15 
calculating a control amount of a half tone region in 
each component of RGB based on said correction 
pattern and said correction amount, 
calculating a control amount of a shadow region in each 
component of RGB based on said correction pattern 
and said correction amount, 20 
calculating said tone curve of each component of RGB 
based on the three kinds of control amounts calcu- 
lated at each said steps, wherein 
at the time of calculating a tone curve, said tone 

curve calculating step performing 25 
a straight line generating module for conducting 
straight line interpolation between a control point 
in a high brightness region and a control point in 
a low brightness region, and 
a curve generating module for conducting curve 30 
interpolation for smoothly interpolating between a 
control point in a half tone region and starting 
points on the high brightness side and on the low 
brightness side. 
3. A computer readable memory which stores an image 35 
processing program for controlling an image processing 
system which conducts necessary correction processing on 
digital image data, said image processing program compris- 
ing the steps of: 

among correction patterns set corresponding to kinds of 4Q 
color fogs, selecting said correction pattern suitable for 
correction of an input image by the operation of an 
operator; 

obtaining a correction amount indicative of an appropriate 

degree of correction on color fog, 45 
generating a tone curve of RGB based on said correction 
pattern selected at said correction pattern selecting step 
and said correction amount obtained at said correction 
amount obtaining step; and 
performing table conversion on image data of said input 50 
image according to said tone curve generated at said 
tone curve generating step to conduct color conversion 
of all pixels of the image data, 
and wherein said tone curve generating step of said image 
processing program comprises the steps of: 55 
calculating a control amount of a highlight region in 

each component of RGB based on said correction 

pattern and said correction amount, 
calculating a control amount of a half tone region in 

each component of RGB based on said correction 60 

pattern and said correction amount, 
calculating a control amount of a shadow region in each 

component of RGB based on said correction pattern 

and said correction amount, 
calculating said tone curve of each component of RGB 65 

based on the three kinds of control amounts calcu- 
lated at each said steps, wherein 
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at the time of calculating a tone curve, said tone 
curve calculating step performing 

a straight line generating module for conducting 
straight line interpolation between a control point 
in a high brightness region and a control point in 
a low brightness region, and 

a curve generating module for conducting curve 
interpolation for smoothly interpolating between a 
control point in a half tone region and starting 
points on the high brightness side and on the low 
brightness side. 

4. An image processing system which conducts necessary 
correction processing on digital image data, comprising: 

correction pattern storing means for storing correction 
patterns set corresponding to kinds of color fogs; 

correction pattern selecting means for selecting said cor- 
rection pattern suitable for correction of an input image 
among said correction patterns stored in said correction 
pattern storing means through the operation of an 
operator; 

correction amount storing means for storing a correction 
amount indicative of an appropriate degree of correc- 
tion on color fog; 

tone curve generating means for generating a tone curve 
of RGB based on said correction pattern selected by 
said correction pattern selecting means and said cor- 
rection amount stored in said correction amount storing 
means; and 

LUT converting means for performing table conversion 
on image data of said input image based on said tone 
curve generated by said tone curve generating means to 
conduct color conversion processing of all the pixels of 
image data, and 
wherein said tone curve generating means comprises: 
tone curve calculating means for calculating said tone 

curve of each component of RGB, 
a straight line generating means for use in the tone 
curve calculating processing by said tone curve 
calculating means to conduct straight line interpola- 
tion between a control point in a high brightness 
region and a control point in a low brightness region, 
and 

a curve generating means for use in the tone curve 
calculating processing by said tone curve calculating 
means to conduct curve interpolation for smoothly 
interpolating between a control point in a half tone 
region and starting point on the high brightness side 
and the low brightness side. 

5. Digital image data correcting method in an image 
processing system which conducts necessary correction pro- 
cessing on digital image data, comprising the steps of: 

among correction patterns set corresponding to kinds of 
color fogs, selecting said correction pattern suitable for 
correction of an input image by the operation of an 
operator; 

obtaining a correction amount indicative of an appropriate 

degree of correction on color fog; 
generating a tone curve of RGB based on said correction 

pattern selected at said correction pattern selecting step 

and said correction amount obtained at said correction 

amount obtaining step; and 
performing table conversion on image data of said input 

image according to said tone curve generated at said 

tone curve generating step to conduct color conversion 

of all pixels of the image data, and 
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wherein said tone curve generating step comprises the 
step of: 

calculating said tone curve of each component of RGB, 
wherein at the time of calculating a tone curve, said 
tone curve calculating step performing 5 

a straight line generating module for conducting 
straight line interpolation between a control point in 
a high brightness region and a control point in a low 
brightness region, and 

a curve generating module for conducting curve inter- 10 
polation for smoothly interpolating between a con- 
trol point in a half tone region and starting points on 
the high brightness side and on the low brightness 
side. 

6. A computer readable memory which stores an image 15 
processing program for controlling an image processing 
system which conducts necessary correction processing on 
digital image data, said image processing program compris- 
ing the steps of: 

among correction patterns set corresponding to kinds of 20 
color fogs, selecting said correction pattern suitable for 
correction of an input image by the operation of an 
operator; 

obtaining a correction amount indicative of an appropriate 
degree of correction on color fog, 



generating a tone curve of RGB based on said correction 
pattern selected at said correction pattern selecting step 
and said correction amount obtained at said correction 
amount obtaining step; and 
performing table conversion on image data of said input 
image according to said tone curve generated at said 
tone curve generating step to conduct color conversion 
of all pixels of the image data, 
and wherein said tone curve generating step of said image 
processing program comprises the step of: 
calculating said tone curve of each component of RGB, 
wherein at the time of calculating a tone curve, said 
tone curve calculating step performing 
a straight line generating module for conducting 
straight line interpolation between a control point in 
a high brightness region and a control point in a low 
brightness region, and 
a curve generating module for conducting curve inter- 
polation for smoothly interpolating between a con- 
trol point in a half tone region and starting points on 
the high brightness side and on the low brightness 
side. 
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